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ABSTRACT 

The purpose of this training workbook . is to provide 
the user with an Li •I^^rstP.nding of Analysis of covariaiice (ANCOVA) 
sufficient to alloi- Ma t.o identify situations in which it can 
increase the credx-' . ,..ity f.nd the statistical power of the analysis. 
The module provides a <;. *n::eptual, nonmathematical overview of the 
purposes of ANCOVA. ThP- assumptions underlying the use of ANCOVA and 
the consequences of thoi^ violation are summarized. An illustrative 
ANCOVA problem is employed to graphically illustrate how ANC-OVA 
removes bias and increases statistical power. A seT f-instructicnal 
problem set is included as illustration and reinforcement for the 
learner. The module concludes with a mastery test. The workbook is 
designed for students in intermediate statistics and experimental 
design courses and for research and evaluation personnel, especially 
those being trained on the job. The book requires familiarity with 
simple regression and one-factor analysis of variance. (Author/SE) 
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; Characteristics of the Product : 

The 26-page irodule provides a conceptual, non -mathematical overview of the 
. purposes of ANCOVA. The assumptions and consequences of their violation is 
j summarized. An illustrative ANCOVA problem is employed to graphically illustrate 
; how ANCOVA removes bias and increases power. A self-instructional problem set 
, is designed to illustrate to and reinforce the learner. The module concludes wit 
1 a mastery test. 

I What it is Intended to do : 

Provide the user with an understanding of ANCOVA sufficient to allow him to 
identify situations in which it can increase the credibility and power of the 
analysis. ; 

Requirements for Use : 
I Familiarity with simple regression and one-factor analysis of variance. 
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10. Product Ui^^ti Thcae indiuiduala or jroupa expe^Jted to uac the rrrduct* 

The product is intended to be used by applied researchers in education and bv 
students in intermediate courses in statistics or exDerimental dfesinn. 



An anonymous ratinq form was given to a group of twenty-five users who responded 
to the instructional value of the module. 35T of tho users responded "very good/' 
50^ reslaonded "aood," and only 15% rated the module as "fair." In addition, only 
15^ indicated that there were other sources that accomplished the same purposes 
that are as good or better. 

The 86X indication of "good" or "verv good" instructional value by users 
suggests learning value and efficiency for the module. The median reported error 
rate was 7.5'. 
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1. The use of analyses that will yields less equivocal results. 

2. The use of more power analyses of research and evaluation studies. 
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the uB^r group; nuritier of posaible eubetitute (coevpetitjr) products on the narket; and 
the likeli^ avai lability of funds to purchoBe product by (for J the product user group. 

Research and evaluation personnel, especially those boi q trained on the job. 
Students in intemiediatc statistics and experimental design courses. 



Instructional Modjle on the Analysis of Covariance^ 



This paper discusses the nature and principal uses of the analysis of 
covariance (ANCOVA). As Fisher (1934) has expressed it, the analysis of .covarlance 
"combine* the advantages and reconciles the requirements of the two very widely 
applicable procedures known as regression and analysis of variance." 

In experimental and quasi -experimental studies covariance can perform 
two distinct functions. One is to remove bias, that is, statistically equate 
groups on some confounding variables. In quasi -experimental studies coping with 
bias is typically its primary function. However, even if there are no real 
differences between the two groups on the covariable, hence no danger of bias, 
covariance rnay still be valuable for increasing the power of the analysis. 

The Use uf ANCOVA 

To remove the effects of confounding variables in quasi -experimental studies . 

In research endeavors in which randomized experiments are not feasible, 
two or more groups differing in some characteristic such as age, can be studied 
tc discover whether there is a significant difference .«mong groups on the dependent 

^The ANCOVA overview is adapted from portions of W. S. Cochran's article 
Biometrics (13:261-278), 1957. 
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variable when groups are statistically equated on the uurdc^ri >tiL on ivfiia. . 
they differ (such as aqe. I.Q, or pretest score). { x.ic^r.lf"-' wnort.. t 'u ^ cxrc-ri'-icnts 
are not practicable or possible are studies constrastinq i.rosb-cu! tur\^] studies, 
social class studies, urban vs.'.rura\ school distr-irti, etc. In quasi- 
experimental- studies it is widely realized that an observed association, even 
» f' stdt 1 sti.ual significant, may De due wholly or part.ly to otfjer disturbing 
, variables Xj, X2 ... in which the groups differ. i.e.,.Xj and are threats 
to the interna} validity of the study. Inhere feasibl^, a common device is to 
:narcn trie .groups for the disturbing variables thought to be most important. This 
n^dtching often results In serious problems' (cf. Hopkins-, 1969). tn the same 
.way, tne analysis of the X-variables ca.n be treated as |^co^^ar^tes and ANCOVA 
b*e employed 10 extricate the influence of X-variables. ^i^jWst partially. 

Ir-' d cu:-pj^-i.SvMi 'of the heights of children from two different types of 
ol'.oc.::,, .rt f.ic-'n (1953) found that the two groups differed slightly, ^nough 
not ■)'■ • tu-.antly, m mean aqe. A covariance adjustment for age resulted in a 
yor,: .--r. . t -.'vt' cciparison of the heights. Anotner study statistically equated 
.':vn--- J' ] n.H;-i--o[.M k- students on IQ when examining achievement consequences 
of -rcrolity. School districts have been compared .if> j^upi] achievement a'fter 
cuvciryiii^ on numerous socio-economic variables. 

UnfortCnately. quasi -experimental studies are subject to difficulties 

of iftterpretation from which true experiments are free. 'Although covariance 

nds L)oen skillfully applied, we can never be sure that' bias, may not be present 

• \ 

tron 'iome disturbing variable that was overlooked. Indeed, unless the covarlate 
is perfectly reliable, ANCOVA does not remove all^of the bias due to X Itself. 
In true exoeriments, the effects of all variables pleasured and unme'asured, real 
and illusory, are distributed among the groups jjy the randomization In a way 
that is taken into account In the standard tests of significance.. 
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There is no such safegyard in the absence of randomization. 

. Secondly, when the X-var"iables show real differences among groups -- the 
case in which adjustment is needed iiiost covariance adjustment!; involve 
a greater -or -less degree of extrapolation. To illustrate by an extreiiie case, 
suppose that we were adjusting for differences in parents' incorne in a comparison 
of fjrivate and public school children, and that the private school incomes ranged 

• • 

from $10,000-$12.000. while, the public school incomes .ranged from $4,000-$6,000. 

• • * ^ .■•*' 

The covariance would adjust results so that they alleq^dly applied to a mean 

income of $8,000 in each group, although neither group has any observations 

« 

in which incomes are at or even near this level. 

Two Consequences of this extrapolation should be noted. Unless the statistical 

assumption of linear regression holds in the region in which observations are 

■ . • . 

Idcking, covariance will not remove all" the bias, and in practice may remove 
only a s.Tall part of it. Secondly, even if the regression is valid in the 
"no^Hcin's land," the standard errors of the adjusted means become large, because 

V 

the standard error formula in a covariance analysis takes account of the fact that 
c-xtra:;ol3tion is being employed (although it does not allow. for errors in the 
forr 0" tne regression equation). Consequently, the adjusted differences niay 
becone ir.si gnif icant statistically merely because the adjusted comparisons are 
of low precision. '* . 

When groups differ widely on some^ confounding' variable X, these difficulties 
imply that the interpretation of an -adjusted analysis is speculative rather than 
definitive. While^there is no sure way out of the difficulty, two precautions 
are wortn observing. 

1. Consider what "internal evidence exists to indicate whether the regression 
is valid in the .region of extrapolation. Sometimes the fitting of a more complex 
regression formula serves as a partial check* 



,2. Examine the standard -erors of the adjusted group means, particularly 
when differences become non-significant after adjustinent. Confidence limits for 
the difference in adjusted means will reveal how precise or imprecise the 
adjusted comparison is. ^ 

- ■ • . r . 

The Use of mNCOVA * > • • ' 

To increase power . 

The use of ANCOVA to increase power in true experiments is frequently 
overlooked. The covariate X is a measurement, taken or available, on each experimental 
unit before the treatments are applied, which correlates with the dependent 
variable Y. This first illustration of the covariance irothod in the literature 
waa of this type (Fisher, 1932). T.hb variate X was the yield of tea per plot 
in a period preceding the start of the experiment, while Y was the tea yield * 
")at the end of a period of application of treatments. Adjustment of the responses 

Y for their regression on X removes 'the effects of variations in initial yields 
from the experimental errors, insofar as these effects are measured by the 
linear regression. "Irv this example these effects might be due to either 
inherent differences in the tea bushes or to soil fertility differences that 
were permanent enough to persist during the course of the experiment. 

With a linear regression equation, the gain in predision from the covariance ■ 
adjustment depends primaridy on the size of the correlation coefficient p between 

Y and X on experimental unita that receive the same treatment. If is the error 
variance when no covariance is employed, ANCOVA reduces this error variance to 

a value which is about 



e 
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where f is the degrees of freedom associated with the error tL'rni. The factor 
involving f^ >s needed to take account of errors in the ehtlniattd regression 
coefficient. If, or the correlation of covariate and the dependent vctriable, is 
less than 0.3 in absolute value* the reduction in variance is incon^equentidl 
.(les,^ than 9:;), but as p increases sizeable increases in precision are obtained. 
In-Fisher's example p-.was 0.928, reflecting a high degree of stability in relative 
yield of a plot from one period to anothen. The adjustment reduced the error 
variance roughly to a fraction (1^- (.0.928)''). or about one-sixth, of its original 
value. Some of the most spectacular- gains in {precision from covariance have 
occurred in situations like this, iji which the covariate rjspresents an inUi'al 
calibration of the responsiveness of the experimental units. In' educational 
studies.it is usually relatively easy to find pretreatment measures that 

irorrelate .6 or higher with posttest measures" thereby reducin,lg the error term 

i 

by 36 or more -- approximately the same gain in power that Would result from" 

s 

doubling the sample size. ^ \ " • i ^ • 

In tne use of ANCOVA to increase power, its function, is the same a^ that of 
strati ticdtion and blocking. It removes the-effects of an environmental source 
of variation that w6uld otherwise inflate the experimental error and hence the 
error mean square. When the relation between Y and X is linear, covariance and 
blocking can be about equally effective. If, instead of using covariance, we 
can group the subjects into block such that the X values are equal within a 
block the error variance is reduced to a^(l - p^). 

In a covariance analysis, the covariate X may be measured on a completely 
different scale from that of the dependent variable Y. Bartlett (1937) used a 
visual estimate of the degree of saltiness of the soil to adjust cotton yields. 
,Federer and Scholottefeldt (1954) used the serial order.(l, 2, ...7) of the plot 
within a replication as a basis for a quadratic regression adjustment of tobacco 
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data, thereby reirovlng the effects of an unexpected gradient in. ftirtllity within 
the replications. Similarly, the reading perfonnances of children under different 
methods of instruction may be adjusted for variations \n their initial IQ'b. 
ffote also that X need not be a direct causal agent of Y it may, for instance, 
merely reflect some characteristic of -the environment that also influences Y. 

When ANCOVA is used in this way, it is important to v.erify that the treat- 

' f \ ■ ■■■ 

njents hav^ haS no* effect on X. This is obviously" true when the X'S were iiieasured 

before treatments have been applied, as when plant number shortly before harvest 

i-s used to'^ adjust crop yields for uneven- growth, or as happened in the index \. 

* •• . ■ . " 

of saltiness used by BaVtlett. When the treatments do affect the X-values 

to some extent, the covarlance adjustments take otV a different meaning. They-. \ 

no longer merely remove a c|>mponent of experimental error — in addition, they 

/ 

distort the nature of the treatment effect that is being measured. If the higher 
perfgrnidnce by a superior reading treatment also improves IQ scores, a covarlance 
adjustment (which attempts to measure what the means would have been if IQ 
means were equdl for all treatments), may remove much of the real t-eatment* effect. 



ASSUMPTIQrjS R EQUIRED FOR THE ANALYSIS H^F CQVARIANCE 

Tne assumptions required for valid use of the analysis covariance are 
the natural extension of those for an analysis df variance, namely, 

(i) Treatment, block and regression effect's must be additive as postulated 

by the model , , T ' 

(ii) the residuals, e,., (differences between observed and predicted scores 

within ^each treatment group) must be normally. and independently distributed 

«fc<. ■ . . 

with zero means and the same variance. 

» .... 
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Much of the related wdrk regarding the effects of. violating statistical 
assuiaip.tions on the anajyvfs of variance eUends logically to ANCpVA --*for 

instance the practic-al unimportance' of the additivity assumption (see Glass,, - • 

/ - ' • • . 

/Peckh,^ni, and Sanders, 1972, p. 241). Table 1 sunmarizes an abundance of 
research literature on (^le enjpirical consequence of violating assumptions in 

Certain qualifications of the conclusions in Table 1 are regarded in the 
extension to ANCOVA. For example, non-normality in the dependent variable 
inconsequential in ANCOVA only if the covariate is normally distributed (which 
in itself is not. necessarily assumed in ANCOVA). 

ANCOVA TOakes thr^ee assumptions that involve the regression term in covariancej 
(1) the regression lines for each group are assumed to be parallel, i.e., 

= ^2 ' ^ ''J- ^^^^ violated, the covariance adjustment may still . 
improve the precision, b^t (i) the meanings of the adjusted treatment effects 
become. cloudy, and (ii) if covariance is applied in a routine way, the 
investigator fails to discover the differential nature of the treatment 
effects a point that might be important f^r practical applications. 

Pecknam (see Glass, Peckham. and Sander:s< 1972) found that violation of 
the parallel regression slopes to be Inconsequential in a, one-factor fixed- 



effects ANCOVA for a wide variety of conditions. The effects in more complex 
factorial design with mixed and random models appears not to have been studied. 

(2) The covariance procedure assumes that the correct form of regression 
equation has been fitted. Perhaps the most common error to be^^aaticipated Is 
that linear regressions will be used,when the true regression is' curvilinear. 
In a randomized experiment, the randonfization insures that the usual interpre- 
tations o*f standard errors and tests of significance are not serious^ vtti^ied, 
although fitting the correct fotnn of regression would presumably give a larger 



Table 1 



SuRtmofy of C0nsequ€nce$ of Vk*taiinn ofA$$umpUom of ihe Fixed-effecU ANOVA 



Effcrt tm a 



nktm^ pa|Ma«4iaci« kmim my Wtto •ffeci cm 9itkH Ih^ 1^ of •IfnlTicMic* or fHrwtr oT fiifd^fffctA wtHlel f-Unl. dMottkM of ikmiiM 



Actual o tliMi noMiiMvl or 

mk9n gkumJwtio— Ivptoktiiiic 

m»inio«J a for ptfUyliiHtic po|^|«- 



Vrty Pilch* effect o« wfikll 
ivklom diAtortfd tiy mor* Uma 

%lm^y to b« rficliUy ktcrmmd 
ovtr Uw iwniji«l 



AcmmI pow«r !• km Uma nomMMt 
power «»<NHij^upulftlioii« §f pk- 
tirkttfftie. Actual powfir MOMdi 
fKNiilital powff when populatlow 
H* toptoltiiitie. Bfffct* CMi Iw 
t wUa f mi al for wmii Ji. 

(Mo tk«of«ticat iPowfT value 
^Ma «1m wiaiiw m Iwttro* 



Acl4ial Q in km Ulan iH«fii<i««l a 
«r|HNi pnpvlalKina are Nf<piolivrttr 
fl.e.. ^2>3). Actual a avcatflii 
nominal d fat pUtylcurlic p««puta> 
ikom. (£rf#cto af^ tl^ht.) 



a may be mtkomly affeciad. 
Adval a meMda iMMUaaH a wlitfi 
•mUaff aamplaa ai« drawo from 
Mre variaWe popula tk wia; actual 
ft > Im Hitii nomittal ft mUnt 
•mallef aamplaa are drawo frocn 
iaaa i|aiiabta populatKNia. 



Artuai powPTia laaa tiMii mhhIimI 
powfr wlNPii«|^op«ilatkMia avt pli- 
lyltuftip. Actual po«<^ «Mt«d| 
tKKaiiial power «lieii pnpulaliaiM.'*"^^ 
arc* Irplohuiilc. Effecu can be^ 



(No tHeorttical 
eiiiata wiien vsriaiwaa ar^ iMrtavo- 



>fti fc inid ROH nomaUly 
ftd iMtafnfaneona 



Non^norm^ily and ^ttaroftntoua variancaa apfwar to combine addMi«ly (^no(^ntmctlvc(y**| tft affect eitlier lt««l of aifntricancv or oowar. (roc 
cvan^Me, tW deptMiing ef feH on ft of Itololiuftoaia eould bo tspecttd to bt count^^ 

froMthoniotoearioblt.lcplolniftkpopuytiomj — 



a 



From 61 ass a Peckham 



. and sande 
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ers (1972). 
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increase in precision. The .danger of misleading results is gredter when chore- 
are real differences from treatnient to treatment on the coVa-f^ate. Fortuiidtely , 
most cognitive and psychomotor variables are linearly related, and unless 
measurement procedures are faulty (e.g.* a test that lacks Veil ing) , the Imear 
regression model works v^rell in most ap^cations (see L'i , 1964, =for tre^j:ment of 
curvil inear ANCOVA) . Frequently, curvilinear relationships can be made .1 Inear 
by mathematical transformations of eivtheV the dependent variable Y. or the 
covariate X, or both. * • , 

(3) An assumption of ANCOVA that is not widely recognized is that the 
• covariate is fixed and measured without error. Lord (1960) has shown how. large 
errors in the covariate can produce misleadi;ig results. The effects of the 
less-than-perfectly-rel iable covariate are usually predictable so the nature of 
the bias in the adjustment can be considered in any interpretation. It should 
be jgmphasized, however, that, to the extent the covariate is unreliable, the 
statistically equating of the groups is incomplete. / ^ 



1 



/ 



ERIC 



10 



Illustrative ANCOVA Problem 



Suppose thereN|fe three Intact groups (A, B, C), each was - given a treatment. 
They were pretested (X) before the treatment and posttested following the 
treatment. The data are depicted graphically on the X and Y axes in Figure M. 
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Within Treatments (E) 
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Total Data (S) 
S = 818 

XX 

S ' 700 
xy ' 

S = 846 

yy 



Between Treatments (T) 



Let's ignore the pretest differences for the moment' and perform ^ simple ANJOVA 
on the Posttest (Y). 



sv 


ss 


df 


MS 


F 


P 


Treatments 


760 


2 


380 


53.1- 


<.01 


error 


86 


12 


7.16 






Total 


846 


14 
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» Obviously, this highly significant difference in posttest means is not very 
meaningful in light of the pretest differences. To confirm our suspicion that 
there were non-random,, systematic differences between groups {(rior to the trt?at- 

> ments, we run. an ANOVAon pretest scores (X) and find that there were highly 
significant differences among groups prior to the treatments. j ^ 



SV 



ss 


df 


MS 


730 


2 




88 


12 


7.33 


818 


14 





Treatments 730 2 165 49.8 <.01 
error 



Total 

r 



JJow, the crucial question is: when we statistically equate groups on the pretest. 
Would there continue to be sigolf leant differences in posttest means. ANCOVA 
allows us to adjust the total sum of squares on the posttest (S ) to (1) ' 
remove predictable portion- due to differences in pretest means {^!he "correcting" 
for bias function of ANCOVA) and (2) take advantage of predictability of posttest 
score from^retest score to reduce our error term (tile power function of 
ANCOVAl. . - 



ANCOVA) . 

To adjust total sum of squares'pS 



yy yy XT" " ' W~ ~ 



XX 



To adjust sum of squares error, E : 

I c = F - ^y - Rfi (50)- _ „ r 

To adjust treatment sum of squares, T : 

^ * yy 

- - ^;y = ^;y - ^iy = 247 - 57.6 = 189.4 

Tne summary ANCOVA table Is shown below: 
^^>- SV SS' df MS' F 



Ti^atments 189.4 2 94.7 18.07 <.01 
errok; 57.6 11 5.24 



•. Total • 247.0 13 

9 

(Note that one df is lost from error for each covariate) 



\ 
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We therefore concludevthen that there are differences among the adjusted posttest 
means that are not explicable solely in terms of initial pretest differences. 

For purpo'ses of interpretation, we need to adjust the postttest means: 

- - - -^j = - ^^^^^^ ' . ^ 

is the adjusted mean of>, the jth group. Except for b^, all the informatiort 
J . ^ w 

-needed to adjust the means p's given in the sunmary data.. The regression coefficient, 

b^, is the pooled estimate , of g^, the "average" slope within the treatment groups. 

b = ^ = S = 57 

■ , ^ ^x ^ • " 

Tne adjusted means of the treatment groups are then: \ 
• . - .... • . . \ 

- 8 - .57(5-14) = 8 - (-5.1) - 13.1 

Y • = 10 - .57(15-14) = 10 - (.57:) - 9.43 . 

= 24 - .>5(22-14) = 24 - ( 4.6) = 19.4 

Figure IB shpws a regression line with slope b,^ fitted to each of the three 

w 

groups. The extension of this^ line to the point at which it intersects with the 
grand mean of the covariate. X^, is the adjusted mean for the group. 

Now is the assumption f5^ = 3g = B^, .which legitimizes pooling, tenable? 

To test H^: = Sg = s^,. we need to compare the sum'' of squares from the pooled 

regression Vine fitted for each group (E^^) with the sum of squares allowing 

each group to "find" its own best fitting individual regression line. Figure 
IC gives the best fitting (least squares) regression line defined separately 
for each group together with the pooled regression line with slope b^. Of 

course the regression line b^ will fit group A bet^r than any other regression 

line including the one with slope b^. Likewise bg and b^ give least error 

for groups B and'C. The real statistical concern ii whether or not b^, bg, and 

differ significantly, that is. is H^: 6^ = 6g = tfenable? If H^^ is tenable then 

the use of the pooled regression* coefficient b^ is legitimized. 

We already have obtained the error sum of squares using the pooled regression 
coefficient b^, i.e., E^^ - 57.6. The error sum of squares for group A 

using b^ is: 

^^xv J' 

V -E . (15)2 _ 




Figure IB. An Illustration of the process of adjusting means for 
pretreatment differences. 





Figure IC. The relationship between regression lines defined by 
separate groups with the regression line employing 
pooled data. 
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Similarly for groups B and C using bg and respectively: 

« » 

V 25.3, E' « 13.5 . 

For convenience define * sE' = error sum of squares when each group defines 
its own best fitting regression ^line. 

Sj = 8.8 + '25.3 + 13.-5 = 47.6 

The reduction in sums of squares when best fitting individual regression lines 
arenjsed (i.e., b^, bg^, and b^) in lieu of regression lines with the regression 

coefficient based on the pooled infonnation(b^). Is defined as S^- 

Sp - £• - S, = 57.5 - 47.6 » 10.0 
*y . 

Obviously, if l>/^ ■ bg « b^,, Sg would be zero. 

To test the significance of the non-parallelism in the individual regression 
lines: 

S^/CJ 10 0/2 5 ^ 

^ ' q/J(n-2) ' ^ 0/(3(3)) " " -^^^ F-ratio is below 1.0 - obviously 

not significant. • - 

In setting up confidence intervals about adjusted means and/or making multiple 
comparisons, MS^ is not used, but MS^ which is larger than MSg to the extent 

that the groupg differed on the covariate, i.e., if T„„ = 0, MS" = MS'. 
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ANCQVA Computational Problem Set 

Fifteen subjects were administered a non-reactive pretest (X) and were randomly 
assigned to one of three treatments. The pretest and posttpst data appear below 
(Winer notation; problem taken from Edwards). 

Treatroept Group 



1 
6 

3 
4 
5 



5 
12 
9 
8 
11 



2 
3 
€ 
4 
7 



1 
2 
7 
3 
8 



1 
4 
5 
3 
6 



10 

13 
16 
12 
17 



Summary Data 

( ) 
z ( )2 
IXY 
Means 



1 X 



19 45 
87 435 

191 
3.8 9.0 



With 



- E 



XX. 



ixyj = E 



xy. 



yy 



I 



22 21 '19 68 i 

114 127 I 87 958 ! 

• 118 I 270 J 

4.4 4.2 ! 3.8 13.6 . 4.0 8.93 



Total s 
(X) (Y) 

60 134 

288 1520 

579 



n Groups Data (£) 



14.8 


V.2 


> 14.8 


• 46'8 * 
1 


E 

XX 


20,0 


' 25.6 


1 21.6 


[ -67.2 * 


^^y 








t 


* 30.0 


[ 38.8 


j 33.2 


j 102.0 « 
1 


^yy 



Total Data (S) 



5xy = 53.0 
Syy - 322.9 ' 



Between Treatments (T) 



^xx ' ^'^ 
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1. Plot Y values against X values for each group. (Use different colors or 
marks for each group for visual separation * 

Following each exercise is a dotted line, below which provides the answers 
to the questions posed in the exercise. Attenipt each question before 
consulting the ansi/er. 

2. Perform an analysis of variance of the posttest scores (Y) so that we may 
later compare the results with those from ANCOVA. • • 

• SV SS__ ^ df r§ F 

Treatments 2 12.99 

error 102.0 8.5 

^. * (.99^2.12 " ^-^3) 

.220.9/2 - 110.45; 102.0/12 = 8.5 

3. Now perform ANCOVA, covarying on X 

m 

Adjusted total ^ 

sum of squares, = S^^ - " ( ) - 7 ^ » 264.4 

322.9 - ' ' ^ 

^' ^yy ■ J " I — 1~ " -.-^IgTl^ = 5.5 = Adjusted error sums of squares 

/ 

E • - (E )2/E 
yy ^ xy' ' xx 

5. "^yy = ( ) - ( ) ' 258.9 (Not -(T^)VTj^^; this is affected by 

error in estimating 8 fronf b.'s.) / 

■J / 

S' - E' \ 

yy yy . 

6. Therefore: . * • . 

SV_ SS df f§ F. 

Treatments (T'^) 129.45 258.4 

Error (E^^) .50 

.99''2,11 " ^-^^ 

258.9/2; 5.5/11 

ERIC 
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7. degreeCs) of freedom ts (are) lost for each covarlate employed 

(one in this jexan^le), which accounts for the slight ^ ^ (increase 

or decrease^ in the critical F-ratios. 



ncrease 



8. Why didn't T* and T „ differ greatly as they did in the earlier illustrative 

yy yy . 

problem? 



because the group means on the covariate differed mi mroally, hence the . 
unadjusted means did not differ greatly from the adjiusted means. 

5a. Will be larger than T^y.as s general rule in true experiments, i.e., 
when random assignment of subject's to treatments has-been employed? 

no, no consistent trend 

9b. When will T^^ « 7^^? ^ 



when = 0 (within cells), or when ITj = * ...=Xj ' _ ] 



10. When will E^^ * Eyy? 



orily when (within cejls) = 0, hence b^^ ^ 0.0 



11. The relative advantage of ANCOVA over ANOVA can be seen best by comparing 
which one of these? ' - ' 

a. E^j, with 

b. T;^wUhT,^ • 

c. s;^ with , • 

d. computed F-vaTues 



a. 



12. The 'gain in the power of ANCOVA over ANOVA is shown by the ratio of MS^ to 
or, in this example, .50/8.5. 



13. The gain in precision is a direct function of the correlation between the 
and the ^dependent variable (within cells, it is not r„.. for all 

L._ ^ y 

observations combined), 
covariate 



14. MS* * MS^(1 - r^), therefore iji this problem: means "approximately^ equal to") 

6 6 « 



r2 ^ 1 - I 1- » 1 - s 1 » .059 = -.941., 



MS './MS 

e' e E 2 

xy. 



if 



15. Mcwre precisely, rj » ^ — — for each group, or pooling our within groups 
, information:. 



jA^Arlllf (This uncommonly high r is the reason MS;1 and MS^ differ so 
drastically.) e e ^ 

16. In ordet; t6 adjust the 7j values to Tj values we must find the pooled 
within-cell regression coefficient, b^. 



67.2/46.8 

17. This value indicates that for every unit a score' deviates from the grand mean 
of the covariate, )f , it will -be expected to deviate units from the 

grand mean of the dependent variable, Y . 



1.44 - ' ! • 

18. Yj, -Vj^. b^(Xj- X.) f { ) - 1.44 ( - ) » 9.0 + .29 = 9.29 

— — — — — i 

9.0 « 1.44 (3.8 - 4.0) " 

19. Since group A was below the grand mean X, Tj^ would be ■ (smaller 
or larger) than 7^. ^ 

larger. - 

20. = ( ).. ( ){J^ - J.) = 4.2 - 1.44(4.4 - 4.0) = 3.62 

T«*- b 
2 w 
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21. Y' 13.6 - 1.44(3.8 - 4.0) = 13.6 + .29 = 13.89. The qrand mean of the 
adjusted .means, Yj - C'^e" n*s are equal), is 

V. = L-XlX^LLLi . = 8.93. 



(9.29) t (3^62) t (13.89) 

22. Does T: ^ T.7 Will this always be the case? 
Yes. Yes. 

Now .let's turn to the question of evaluating our assumptions. (Ideally, one 

should do thvs prior to performing the analysis.) 

» Z3. An assumption in. ANCOVA is that the wlthin-group regression lines are 

i)aralleK In more symbolic fonn:-bj, bg ... h. differ only randomly from 

the parameter, ; or equivalently; 8, = 6^ 6-. 

I c J - 

2$.- In order to test H^: 8^ " ^2 ' ~ compares the pooled variation 

within each group about it3 own best-fitting regression line, with the 
pooled variation within groups about a regression line with the comnon 
"average" slope,. b„. We have already computed the latter, which carried the 

symbol: - 5.5. 

• - .. 

£ • ' * ♦ 

yy . 

25. Now the E'J>«ilues (allc^ing^ach group to define its own least-squarps 

yy ^.--.---'''^^ <* < - '1 

regression line) are given by: ' • 

(E )2 
^ xy ' 



3 

^y^' = .70; t;^^' 33.2 - if^fii = 1.68 



38.8 - iflfi 
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26. Then the variation within each group about its own best-fitting regression, 
summed for all groups, Sj. is + + » 5.35. 

(Note that Sj does not refer to group 1 but is total sum of squares -wiien 

each group is allowed to define its best fitting regression line.) 

2.97 + .70 + 1.68 

27. Obviously, S, (can or cannot) exceed E*^ 

cannot 

28. When would Sj = E^^?' / / 

^^^^^^^^^^^^^ ^ 

when a U cells had precisely the same regression coefficient, i.e., ^^j^bg-bj^b^^ 

29. and E^^ should differ only randomly if H^: is true. .^^ 

r 

Sn ~ So ^ • • • ^^ 6 • 

I z . : . ^ 

30. The difference in unpredictable variance, allowing each groi-p to use its 
own regress ion -coefficient in predicting Y from X, from that In which all 
use the pooled value is then: = ( } - ( ) = 5.5 - 5.35 = .15 

E' - S 
C 

31. By dividing and Sj by their respective de^es of freedom, (J - 1) and 

J(n -2 ), we have two unbiased estimates of population variance which will 
follow the central F-distribution when H^: = " ' true. 



F -' V^.^ 'y . ( )/( ) . .075 . 



(•15)/(2) 

32. Is it necessary to reference the F-table? Why? 

No, if F < 1, is never rejected in the typical (one-sided) F-test. 



o 

ERIC 
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The test of linearity is considerably more involved, the basic rationale being, 
by allowing a quadratic, or cubic, etc. expression into the regression equation, 
to give the best-fitting curvilinear regression line, would the ly^ be significant 
Jess for the curved regression line th&fi for a single straight line? The researcher 
•usually knows from previous study,th| variables which are more likely to be 
• related in a non-linear fashion, i.e., personal, social, affective variable. 
Curvi linearity may be removed fay certain transformations or it may be builr in 
an. ANCOVA model (cf. Li, J. C. R., Statistical Inference , Vol. II, 1964). The 
procedures nn a factorial design are the same, the cell being analagous to the 
group in the present. example. 

Comparing 'ANCOVA With Other Analysis Strategies . 

It is interesting to compajfe the ANCOVA results with the probable results had 
' " a randomized blocks design been used, blocking on pretest scores. 



SV 



SS 



df 



MS 



Treatments 

Blocks 

Error 



220.9 
98.3 
3.7 

322.9 



2 
4 
8 



110.45 
24.56 
.47 



235.02 



^ 33. The MSI from ANCOVA is slightly 



(larger, smaller) Chan the error MS 



from the analysis from the randomized blocks design, 
larger 

34. However, the error term in the latter analysis is^basedT on 

<8 vs.«_J degrees of freedom which requires a ^(larger, smaller) F-value 



(fewer, more) 



in order to rejecf H^^. In this case for ANCOVA, ggFg = 3.89, and 
for the randomized blocks design, ggFg g = 4.46. 



fewer; 8 vs. 11; larger 

35. The randomized blocks analysis is more "robust" in that it is free from 
assumptions of paral)/fel regression lines and implicit in ANCOVA. 

linear regression 

36. Edwards (1960) performed an ANOVA of the same data using gain scores (posttest- 
pretest) for each subject 



SV 



SS 



df 



f6 



Treatments 
E-rror 



250.5 
-14.4 



2 

12 



125.3 
1.20 



104.4 



\ 



It is evident in comparing error Mi values, that the latter analysis is much 

, (more, less) efficient tfTan the ANCOVA and randomized blocks 
oesTgnT • 

less 
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Post Organizer 

ANCOVA can be a useful statistical tool both for true and quasi-expen'ments. 
Its two potential advantages over ANOVA are (1) statistical conipensation for 
pretreatment differences or 'bias, i.e., removing various "selection" threats 
to the Internal validity of the study, and (2) increasing the power of the analysi 

With respect to the bias removing function it is important to be aware that 
pretreatment differences may exist on certain unmeasured variables, hence the . 
adjustments are never complete and impeccable. In addition, the statistical 
compensation will be incomplete to the- extent that the covarlate is qhreliable. 
ANCOVA cannot bring results from a quasi -experiment to the same'-lev'el of 
credibility allowed by a true experiment. 

Regarding the increase in power function, ANCOVA can make a substantial 
contribution to true experiments. If the covariate (or combi..ation or covariates) 

r 

correlate about .7 with the dependent variable within groups, the gain in power 
is approximately the same that would accompany a four-fold increase in N. 
There are other design and analysis strategies for capturing this'gHn in 
power, the most common of which is blocking or stratHfying on the X-varVdble. 
These alternatives are generally preferable if the experimenter has complete 
control over the conditions of the study since the unique ANCOVA assumptions 
are of no concern and stratifying allows one to detect interaction effects 
between the treatments and the X-variable. 

The basic ANCOVA rationale extends logically to multiple covariates where 
the covariates are the predictors in a multiple regression context. 




V 
A 
R 
I 
A 
B 
L 
E 



1. 



3. 
4. 
5. 
6. 



8. 
9. 

10. 



Mastery Test on ANCOVA 




U 




Covan'ate 



III 





Covan'ate 



Covariate 



By examining the situations depicted above, how does the adjusted 
"^treatments ^^^"^ ^^^^A, cornpare to the MS^^g^^^^^^ had the covariates 
been ignored and an ANOVA performed? 



^treatments ^^"^^ differ little in situations 
increase in situation 




, and 



2. In which situation will the adjusted error mean square, MS*, differ 



little from the unadjusted error mean square, MS ? 

The gain in power from ANCOVA over ANOVA appears greatest in situation 

Do the data suggest any serious violation of ANCOVA assumptions? 

Which situations appear to represent quasi -experiments? , 



In which situation are the results from ANCOVA would be almost identical 
to those from ANOVA? 

In figure I, the adjusted mean of the E group' would be nearest of point 
a, b, or c? 

An additional covariate appears to be needed least in situation I, II, or III? 

Otner things being equal, in which situation has the smallest adjusted 
error mean square. MSg? 

b^ in group II is about . 



2. 
• 3. 

4. 
"5. 

FRir 



ANSWERS: 

1. M and III, I 
II 
III 
No. 

I and II 



6. 
7. 
8. 
9. 
10. 



II 
C 

III 
III 
0.0 
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